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ABSTRACT 

This paper presents the results of a comparison of 
the effects of gender on fourth-grade students' learning in hands-on 
science. This study is part of a 3-year classroom based project of 
hands-on science in 6 urban and 2 suburban classrooms (n=171) . Half 
of the teachers used a supported-inquiry approach, and half used 
activity-based science to teach a hands-on science unit on 
electricity over a 6 week period, each completing 12 learning 
experiences. Both approaches engaged students in hands-on 
exploration. Teachers participated in a 1-day training session, 
followed by two after-school coaching sessions. A written electricity 
test was used as a pre and posttest. A diagram analysis exam was used 
as a posttest only (both instruments are in the appendix). There were 
no gender effects on the pretest, posttests, and assessment modality. 
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Introduction 

Inquiry-based science instruction is receiving renewed attention because it fosters higher 
order thinking and can potentially benefit ALL students, including those considered at risk 
(Educating Americans for the 21st Century, National Science Board Commission, 1983). In 
addition to racial/ethnic minorities, women are included as an at-risk population in the NAEP report 
cards on science achievement (NAEP, 1988). As a group, girls have a more negative attitude 
toward science than boys, fewer girls than boys study science in school, and girls' achievement on 
standardized tests of higher-level science skill is considerably less than boys (MuUis & Jenkins, 
1988). Additionally, low percentages of women pursue careers in science- and technology-related 
fields (Sjoberg & Imsen, 1988). 

Currently, researchers are examining socioculturai factors that may contribute to the 
disparity in science performance between girls and boys. For example, in most cultures, science is 
defined in masculine terms. In one study when asked to draw-a-scientist, only 28 of 4,807 
students drew a woman (Chambers, 1983). Additionally, differences have been found in tiie 
amounts and kinds of informal experiences boys and girls have with science, and in the treatment 
and interactions of girls and boys in the classroom. 

Several studies provide evidence that young girls have different and fewer out-of-school 
experiences with scientific phenomena, and that these are just as important for student learning as 
more formal school experiences (Kahle & Lakes, 1983). Based on interviews with twelfth-grade 
students to determine the knowledge base they used to answer questions on a standardized science 
achievement test, Erickson & Farkas (1991) found that females referred more to school-based 
experiences, while males referred more to out-of-school experiences to explain their answers. The 
achievement of boys on this measure exceeded that of girls. The authors concluded that boys are 
able to apply the science knowledge they attain from out-of-school experiences to a broader range 
of tasks than girls who draw upon predominately school experiences. 

Differential treatment by teachers and the ways that boys and girls interact and participate in 
the science classroom have also been shown to contribute to gender differences in performance and 
interest in science. One explanation for the differential treatment by teachers is their perception that 
boys have stronger scientific abilities than girls. In one study, Shepardson & Pizzini (1992), 
found that teacher bias resulted in their inclination to ask boys more open-ended questions, such as 
analyzing data and explaining results, and to ask girls more factual questions, such as experimental 
procedures and observations. Observations of high school science classes (Jones & Wheatly, 
1989; Haggaity, 1987) revealed that males tend to manipulate the equipment more during labs 
while the females watch. "Tiese authors suggest that this pattern of performance reflects males' 
perceptions that 'doing' science means hands-on exploration of scientific problems and questions, 
and females' preceptions that 'doing' science means finding the right answers. Males are also 
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more likely to attempt responses to questions even when they are unsure of the answer, enabling 
the teacher to prompt and guide them to a more accurate response. In cntrast, females tend to take 
fewer risks in volunteering answers if they are unsure about its "correctness" (Haggarty, 1991). 
As a result, fewer girls than boys actively participate in and demonstrate science activities and 
experiments (Kahle, 1988). 

Purpose and Questions 

This paper presents the results of a comparison of the effect of gender on fourth-grade 
students' learning in hands-on science . The study is part of a three-year classroom based project 
of hands-on science in six urban and two suburban fourth-grade classrooms (Dalton, Morocco, 
Tivnan, & Rawson, in press; Morocco, Dalton, Tivnan & Rawson, 1992). The project compared 
two hands-on approaches to teacliing electricity — supported inquiry science and activity-based 
science - in six urban and two suburban classrooms over a two month period. Results of the 
original study clearly demonstrated that hands-on science benefited student' learning, and that the 
supported inquiry approach was particularly beneficial. Of particular interest was the fact that 
hands-on science was effective for students with and without learning disabilites, low and high 
achieving students, and urban and suburban students. The positive results for these learners 
considered 'at risk' in science suggested that these approaches to hands-on science might also 
benefit girls. Both approaches include features identified in previous research on programs that are 
successful in encouraging girls in science, such as engaging girls in hands-on activities, allowing 
them to become full partners in the discovery process (rather than observers or recorders) and 
putting them in charge of their learning (Ellis, 1992; Frederickson & Nicholson, 1991; Kahle, 
1985). The following questions guide the current analysis: 

What effect does gender have on fourth-grade students* learning in a hands-on electricity unit? 

Does the effect vary as a function of students* gender and level of domain knowledge after 
instruction? 

Does the effect of the assessment modality vary as a function of students' gender and level of 
domain knowledge aft^ instruction? 

Method 

Overview of procedure Six urban and two suburban teachers in the metropolitan Boston 
area participated in this study* Half the teachers used a supported-inquiry approach, and half used 
activity-based science to teach a hands-on science unit on electricity over a 6 week period, 
completing 12 learning experiences* Both approaches engaged students in hands-on exploration* 
Teachers participated in a 1-day training session, followed by 2 after-school coaching sessions* 



Research staff visited each class weekly to provide technical assistance and support While the two 
approaches to hands-on science differed in several key respects, both approaches focussed on 
engaging students in hands-on exploration. Typically, teachers introduced the lesson to the class, 
had students work together in ane-gender pairs to carry out the experiments, and then gathered 
the class together again to share results. 

Students . 171 fourth-grade students in six urban and two suburban classrooms 
participated in this study, including 81 girls (see Tables 1 and 2). To test effects on students with 
different levels of domain specific knowledge, we constructed a composite electricity knowledge 
score based on post-instruction performance on a written questionnaire and diagram test and 
classified students as high achieving (top third), average achieving (middle third) or low achieving 
(bottom third). 

Assessment measures and scoring. Two forms of alternative assessment were used to 
assess students' understanding and application of electricity concepts: a written questionnaire 
requiring students to write and, in some cases, draw their responses to open ended questions, and 
a diagram analysis test requiring students to construct a response based on their analysis of figural 
information (see Appendix A). All students were administered the written questionnaire before and 
after treatment The diagram test was administered after treatment only. 

We developed and piloted the instruments, scoring criteria and scoring procedures in Year 
2 and tiien fieldtested a revised version in Year 3 (see Figures 1 and 2). Internal test reliability is 
strong (Cronbach's alpha coefficient = .75 on the pre-questionnaire, ,86 on the post-questionnaire 
and .67 on tiie diagram test)- After training, six independent raters evaluated the quality of 
students' responses on tiie questionnaire and diagram tests, assigning each item a score from 1 (a 
naive, or egocentric response) to 4 ( an elaborated correct response). Twenty-five percent of the 
tests were scored by two raters to assess inter-rater reliability. The median percent agreement was 
•74 on the pre-questionnaire, ,69 on the post-questionnaire and .88 on the diagram test 
Correlations on the total scores given by the 2 raters were .91 on the pre-questionnaiie, .93 on the 
post-questionnaire and .94 on the diagram test 

Analysis and Kev FSndini?s 

Analyses of variance were used to compare students' performance on the pre-post 
questionnaire and diagram post-tests. In addition to assessing overall growth, we analyzed 
performance in relation to four key concepts (simple, series, and parallel circuits, and 
conductivity). Key finding are listed below and illustrated in Figures 3 and 4: 

• Prior to instruction, girls and boys had comparable levels of electricity knowledge on the 
written questionnaire(F(l J70)=.01; p<.941) 



-4- 5 



♦ After instruction, girls and boys demonstrated comparable levels of growth in their 
understanding and application of electricity concepts on the written questionnaire 
(F(l,170)==.34; p<.562). They also performed comparably on the constructed diagram 
post-test (F(l,170)=2.52; p<.115) 

♦ Analysis of electricity concept scores were consistent with the overall results. Girls 
performed comparably to boys on even the most difficult concepts, such as parallel cucuits. 

♦ Girls and boys obtained higher scores on the constructed diagram test than on the 
questionnaire. The effect of the assessment modality did not differ by gender 
(F(l,170)=.00; p<.997). 

♦ Girls, as well as boys, were a diverse science learning grour, including low, average and 
high achieving science learners. There was no interaction effect for gender and domain 
knowledge after instruction.(F(2,164)=2.1; p<.125). 

CQntlusiQns 

The lack of any gender effects offers additional support to the argument that challenging, 
hands-on science can successfiilly engage girls in science and lead them to achieve as well as their 
male counterparts, even in the traditionally masculine domain of electricity. 

The study raises interesting questions for further study. In addition to the shared features 
identified in other research as promising for girls' learning in science, these classrooms used samc- 
gender partners for the hands-on component of each learning experience. Given the reliance on 
mixed-gender groups in many science classrooms today, it would be useful to investigate whether 
the gender composition or the size of the grouping had a differential effect on girls versus boys. 
Also, while this study assessed student learning, it did not examine whether girls and boys arrived 
at that learning in different ways. It may be that there are important differences in girls' and boys' 
approaches to hands-on science and problem solving that will contribute to our understanding of 
how best to teach science. 
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1. Imagine you have a battery, a bulb and some wire. 

la. First, draw a large diagram of the bulb, showing all the different parts. Label 
each part of the bulb. 

lb. Second, add the battoy and wire to your diagram, showing one way to light 
the bulb. Label ail the parts you know, 

Ic. Describe what happens to make your bulb light up, 

l± What could you do to make the bulb bum brighter? . 

le. What would happen if you added another bulb to your set-up? 

2a- What is an electrical 'conductor? 
2b. Give an example. 

3a. What is an electrical *insulatoc7 
3b. Give an example. 

4. If you want to test whether a dime conducts electricity, what could you do? You may 

draw to help c^qplain your answer. 

5. Carlos and Sue tried to light a bulb with a battery and some wire, but it didn't work. 

5a. What could be the problem? (list as many problems as you can) 
5b. How would you check it? 

6. Sue had a string of tree lights. She unscrewed 1 bulb and all the lights went out 

6a. Why? 

€b. Draw a large diagram to show how the bun)S could be wired in the died 



7. Marcos had a different string of lights. When he unscrewed one bulb, the rest of the 
lights staved on. 
7a. Why? 

7b. Draw a large diagram to show how the bulbs could be wired in this circuit 
S. Why is a switch an important part of an electric dtcuit? 



Concept Scores: 

Simple circuit c questions la and lb 
Coodoctivity c questions 2a, 2b, arid 4 
Series dioiit « questions 6a and 6b 
Paralld dicoit e questions 7a and 7b 



Appendix A-1. Pre/post written questionnaire Items « 



8 



1 



t YES, dr»w (f»« patfi^ In Rax 




watf»«bob«gtr? . 



4 




0«S50< 5. 




If YHS. draw pathway RED. 




ir HO, vi<v3rs the probtem? 







^ Ooel 













Wof*^«s o( bob #1 Is 
now? 




Vrtal <i3 yog pf*AS 



pagcl 



page 2' 




#6<bcirmdombul>) 




VYCS.dcmrt««Qi0M«y fa Bex* 
«NQl.iNMBth«piQb(Mi7 



VMbub#Slgt<7 

C YES.daRWlh« p«rvMy In RSX 





«NQl,%iM»«ii|MQblM? « 



pages 



page4 



coyr^^PP^^^^ ^""^^ Diagram analysis post test* ^ 



TABLE 1 
Student Sample 



Level of Post-lnstmction Domain Knowledge 
Low Average High 



Gender 



Girls 
n^81 



Boys 
n^90 



23 (28%) 


25 (30%) 


33 (41%) 


31 (34%) 


34 (38%) 


25 (28%) 



TABLE 2 

Background Characteristics of 4th-grade Girls and Boys 



Girls Boys 
(n=81) (n=90) 



CA (months) • 

Mean 117 119 

(SD) (5.2) (6.6) 

Ethnicity (percent) 

White 60 66 

African American 27 22 

Latino 9 7 

Other 4 5 

Percent ESL 14 25 

Percent Urban 64 73 

Achievement (percentiles)^ 

Spelling mean 56 . S3 

(SD) (28) (28) 

Range 1-99 1-99 

Math mean 48 43 

(SD) (26) (27) 

Range 10-99 1-99 



1. WRAT-R administered prior to instruction 
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GliNIII^L SCORING Clini- W A 

UivclO: No response, resfwnds with "I don't kj>ow/ or provides an uriscorable response. 
Level 1: A naive or descriptive answer tliat is egocentric Lnelevant or repeats the qucstioru 

Level 2: A response lliat is Incorrect or ignorant of ll^e concepts (2A) or one that shows a clear confusion between two 
concepts — misconception (2D). 

Level 3: A generally good response, which nxay contain an inaccuracy, pn^vide only a partial explanation or omit one cf 
the cximplcs called for. 

Level 4: A complete and accurate response, ' 



EXAlvlPLE OF ONE LD STUDENTS GROWTH 
IN PARALLEL ORCUrrS 

7- _ MarxDOshadadi£ferentslxingof lights. When he un- 
sgnewfxl one bulb^. the rest of the lights stayed on. 

7a- Why? 

"70. Diavra LARGE diagram to show how the bulbs 
Gocild be vdted in this dicuit 



Joy (10}-^IV»4«< teipowe (¥M«fKJ •cwe^t: <fcw<fKf tco(em\ ) 




Figure 1. Cleneral scoring criteria, with a sample rating 
responses on a parallel drcuit questionnaire ifjem given pre- and post- 
instruction. 
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Jd, Wliai could you do to make (he bulb burn bnshUr? 
( VERSION B^^QUESTIQN iC) ^ ■ " . 

The purpose of diis question is to assess sajdcots' uiidcrsundijig of tJbc rcbdonsliip 
fxrwoca bulb baighmcss and other cotupoacnts in the circuit. To inorcasc the brightness of 
a bulb in a simple cinruit, ihc amount and/or flow of electric cmrcac must be increased- This 
can be done most easily by increasing ihc voltage (niunbcr of banoics oi* baacxy voltage) 
without inQT^ising the resistance (bulbs, wires). 

level 4: Student knows that incrcasiag the voluge will zncicase the bulb's brightness 'and 
also tnencioos the baacrics should be in scries or ofifcrs more than one opdon . 

• "get a more powerful battery, a brighter bulb, or two baaerics" 

• *'usc.2 batteries, one on top .of another*' 

IcXClJi: Student knows that increasing ifac voltage will increase the bulb*s brightness, but 
does not cacntioa the batteries should be in $aics or docs noc offer coore than one option 
. OR suggests a Jess likely solutioa tfaax potcntLally could affect the bulb's bri^tncss by 
manipuladng tiic amount of ics^^^anoc in the dicui t OR gives an incotnplcte or partially 
conecticsponse. The pony ct rtf on should relate to level 4 responses. Thcxncorrect 
ponioa may cocTcspoad to level 2 responses. 

• ""add another battery.*' 

• "get a mote oov/crful battcrv." 

- make the filament snialkr 

• get a thicker strip of'wiie 

• yet more batteries and dc the wire to the part that you plug into the lamp. 

level 7: (2A) Student provides an inoonxct cxplanatioQ legaiding the lelarionsbip between 
voltage and xesistancc, applies an inclevant use of ditaiit knowledge OR (2B) evidences a 
miscoDOcpdoa (coofuses brighmess with number of bulbs and not the amount of the energy 
source OR equates faster ligSc with more powerful fight OR equates die tighmess of the 
coonecdoa to the level of brig^itocss). 

• add another wire 

• too<±riK5 bottom of the bdb to die baticiy, but keep the wire wappcd up 

• putitinadailcroom 

level 2B: 

• use two bulbs 

• you could buy a brighter fight bulb 

• put the battciyoa a higher speed of li^t 

• push the wires harder 

level 1: Student offers a naive or egocentric xespoosc, an iax:levcatrespo^ 
dicuits, OR icUcs cnriiely oa cxpcricaoc/knowicdge of household dcctridQ^ • 

• let it suy on till it bom 

• screw it into a laa^sscKket and cum oa the power meaning turn or fUclc 
switch 

jcvdO: student docs not le$pood♦xcq)Oflds^<too'tkllO^ 
zesponse. 

• if you pot a dicre battery 

(ald^gh we nuglht infer that saia meant * a dkte* to mean ^'a^^ 
batcexy. i^s too oicich of a jun^ ia this case to Gcve 



Figure 2. An example of specific scoring criteria for 
questionnaire item 2c 
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Figure 3 



4th-Grade Girls' and Boys' Performance on Pre and 
Post Measures of Electricity Knowledge 




Figure 4 

4th-Grade Girls' and Boys* Performance by 
Level of Domain Knowledge 
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